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Abstract 



We give a new characterization of Elfving's (1952) method for computing c-optimal de- 



signs in k dimensions which gives explicit formulae for the k unknown optimal weights and 
k unknown signs in Elfving's characterization. This eliminates the need to search over these 
parameters to compute c-optimal designs, and thus reduces the computational burden from 
solving a family of optimization problems to solving a single optimization problem for the 
optimal finite support set. We give two illustrative examples: a high dimensional polynomial 
regression model and a logistic regression model, the latter showing that the method can be 
used for locally optimal designs in nonlinear models as well. 
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1 Introduction 



Elfving ( 1952 ) gave an elegant geometric characterization of c-optimal designs for linear regres- 



sion models by associating the design's support points and weights with a weighted and signed 



linear combination of those points, for a certain optimal choice of signs (see also Chernoff 



1972, 1999). This can be used to immediately find c-optimal designs in 1 or 2 dimensions, but 



the state of the art for k > 3 dimensions is an algorithm of Lopez-Fidalgo and Rodriguez-Diaz 



(2004) that involves searching over the unknown signs and support points. After introducing 



our notation and assumptions in Section |1.1| in Section [2] we give a new result on Elfving's 
method which gives explicit formulae for the optimal signs and weights for any candidate 
set of support points, thus reducing the computational cost of the design, greatly when k is 



large. Torsney and coauthors (Torsney, 1981 Kitsos et al. 1988 Pukelsheim and Torsney 



1991 ) have given a different characterization of the optimal weights, but the novelty of the 



current method is (i) by giving both the optimal weights and signs, the current method allows 



fast computation by using Elfving's geometric method along the lines of Lopez-Fidalgo and 



Rodriguez-Diaz (2004) without needing to search over all signs, and (ii) the formulae for the 



weights and signs also hold for suboptimal support points, which are often used in practice. 
In Section [3] we discuss two examples: high- dimensional polynomial regression and estimating 
the turning point of a quadratic logistic regression model, in which we use Ford, Torsney, and 



Wu's (1992) results for locally c-optimal designs in generalized linear models. 



In addition to the references already mentioned, there has been much recent research on 



Elfving's problem, of which Studden (2005) gives a review. Dette (1993b) showed that the 



°MSC 2000 subject classifications. Primary-62K05; secondary-62J05. Key words and phrases: c-optimal design, 
polynomial regression, logistic regression. 
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popular D-optimal designs can be written as a sequence of c-optimal design problems and 
also considered a Bayesian approach. Later, Dette ( 1997) proposed "standardized" optimality 
criteria to optimize estimation of a set of parameter values, in various senses, which involve 
c-optimal designs as their constituents. Elfving's method has been generalized by Dette and 



coauthors in several other directions as well in 


Dette and Studden 


(1993) 


Dette 


1996 


), 


Dette et al. 


(' 


2008 


), 


Dette and Holland-Letz (2009), and Dette et al. ( 


2010). 




Fan and Chalonei 


- (2003 


) characterized a certain generalized inverse of a candidate 



design that can be used to assess optimality. In a recent application, Bartroff and Lai ( 2010 



2011 ) have proposed using c-optimal designs as "base designs" in dynamic programming-based 



dose-finding clinical trial designs which are computed repeatedly in sequential Monte Carlo 
simulation, putting a premium on efficient computation. 



1.1 Notation and assumptions 



We assume that the scalar-valued response variable Y is normally distributed with mean 6'x 
and variance a 2 , where prime denotes transpose, 9 G M. k is the unknown parameter, and x is 
the design point taking values in the compact design space X C R k . Our main assumption is 
that any collection of linearly independent (LI) vectors x±, . . . , X£ G X, £ < k, can be completed 
to a LI set x±, . . . , Xj>, xi+i, ■ ■ ■ , x/. G X of size k; this is not a strong assumption and any X 
not satisfying this can be reduced to a smaller dimensional case, in some sense. We define the 
information matrix of a given measure £ on X as 



M(0 



xx £(dx). 



x 



For a given nonzero vector c G M fc , the c-optimal design problem is to find a design measure £ 
achieving 

nun <£(£), where = c M(£) _1 c. (1) 

Here H is the class of designs for which c'9 is estimable, i.e., 

£ : / £(dx) = 1 and c = M(£)d for some del 
Jx 

The class 5 may admit singular designs in which case M{0~ 1 in Q means a generalized 

p. 469) and the quadratic form c'M(£) -1 c is invariant under 



inverse see 



Seber and Lee 



2003 



which generalized inverse is chosen. Also define 

E(xi, . . . , xe) = {£ € S : supp(£) C {x 1} 



,%£}}■ 



Elfving (1952) gave the following elegant solution to the problem ([!]). Let X denote the 



reflection of X through the origin and £ = conv(,YU X~), the convex hull of X\J X~ . Points in 
£ , the so-called Elfving set, can be written in the form Yli=i Vi E % x ii where pi > 0, Yli=iP^ = ■*-> 
£i G { — 1, +1}, and Xi G X. Let z = YH=\Pi e i x i G <5 be the point on the ray 



R( c ) = { 7 c G M. k : 7 G R} 



(2) 



that is furthest from the origin. Then the design {(xi,pi)}f =1 , which puts weight pi on point 
Xi, i = 1, . . . ,n, is c-optimal. Moreover, n can be taken to be k by Caratheodory's theorem, 



and 



(3) 



See Chernoff (1972, 1999) 
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2 A new characterization of Elfving's method and 
an improved algorithm 

For LI vectors x\,...,xg G X, £ < k, such that c G span(xi, . . . , xg), define the design 
. . . , xg) and the point z*{x\, . . . , xg) G M fc as follows: 

C(xi,...,x i ) = {(x i ,p*)} i t= i (4) 

. . . ,xg) = ^2e*p*xi, (5) 

i=i 



where 



e* = e*{xi, ...,xe) = sign (x-M 1 c) , i = l,...,t, (6) 
M = M ( {(xi, l/£)} i=1 ) and M~ l any generalized inverse, (7) 



p* =p* i (xi,...,x i ) = I^M- 1 ^ /J2\ x J M ' lc \ ' i = 1 ---^- (8) 



Our main result, Theorem 2.1, is that solving the single optimization problem of maximizing 
the function 

4>{x-y, ...,x k ) = \\z*(x!, . . . ,x k )\\ 2 
over S = {(xi, . . . , xt) G X k : x\,...,x^ are LI} gives a c-optimal design. The proof of 



Theorem |2.1| is given in the Appendix, as well as proofs of Proposition 4.1 which establishes 



the properties of £*(xi, . . . , xi) and z*{x\, . . . , xg), and Lemma 4.1 relating span(xi, . . . , xg) to 
the column space of M({(x{, qi)Y i=l ). 

Theorem 2.1. Let (x\, . . . , x*^) = argmaxs (j)(xx, . . . ,Xk)- Then the design 

e(xi...,x* k ) = {(x*, P *)}i =1 

is c-optimal, where p* = p*{x\ } . . . , x* k ) are given by Q. 
Remarks. 

1. There is nothing special about the weights l/£ in ([7]). In fact, any strictly positive 
constants a\, . . . ,ag (not necessarily summing to 1) can be used if we replace M in Q- 
by Ya=i a i x i x 'i an d P* ' m © by 

/ £ 

p* = en \x' i M~ 1 c\ I ^2 a 3 \ x 'j M ~ lc \ ■ ( 9 ) 
/ j=i 

2. In practice, one is often constrained to apply a suboptimal design with support on some 
given set. Thus it is convenient to be able to compute the optimal weights for the given 
support set. Claim [5] of Proposition 4.1, given in the Appendix, shows that ^ can be 



used to find these. 

3. For many models of interest, the vectors x G X C M fc are actually functions x = x(u) of 
a scalar u G U C M, for some closed interval U. In this case the optimization problem 



of size k 2 (i.e., k vectors in in Theorem 2.1 reduces to an optimization problem of 
size k. 
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3 Illustrative examples 



3.1 Polynomial regression 



The method of Theorem 
model Y ~ AT(^ =1 Oi 



u 



2.1 was used to compute the c-optimal designs in the polynomial 
for k = 6, . . . , 10, u G [—1, 1], and for c equal to the k standard 
. . . , e/c = (0, . . . , 0, 1)'. The corresponding designs for k = 3,4, 

1, 2 cases 



basis vectors ei = (1, 0, . . . , 0)' 

and 5 appear in Lopez-Fi'dalgo and Rodriguez- DiaQ ( |2004[ Table 5), and the k 
are well known. Here, in Table [TJ and in the next section, we abuse the above notation slightly 
by parametrizing designs by u G [—1, 1] rather than x = x(u) = (l,u,u 2 , . . . , u fe_1 )' G R fc . 
A few interesting properties of these designs are (i) all are symmetric about u = 0, (ii) for 
all k, the ei-optimal design is £* = {(0, 1)} with ^(.f) = 1, and (hi) for all k, the ej-optimal 
design has positive weight at u = if and only if j is odd. These and other properties were 



noted by Studden (1968) who solved this problem explicitly using Tchebycheff systems. 

The algorithm was implemented in Matlab using its fminsearch optimizer. On a 2.6 GHz 
laptop computer, the design in Table [T] that took the longest to compute took roughly 3 
seconds. We have computed these designs up to dimension k = 20 using the same method 
with the longest taking roughly 10 seconds. 



3.2 Quadratic logistic regression 



We consider c-optimal designs for finding the turning point of a quadratic logistic regression 
model. Suppose Y takes the values or 1 according to 



P & (Y = l\u) = 1/(1 + e 



-(6 1 +6 2 u+e 3 u 2 )^ 



(10) 



where 6 = (6\, 62, 63)' and the scalar u takes values in some interval, taken here to be [—1,1]. 
For example, this quadratic logistic regression is popular for modeling the response to treat- 
ments for diseases other than cancer, for which efficacy is assumed to have a unimodal rela- 



tionship to dose u (e.g., Thall and Cook, 2004, p. 686). In settings such as this it is assumed 
that #3 < and it is desired to estimate the dose rj = —62/(263) maximizing probability of 
response Y = 1. Given an estimate 6 of 6 with #3 7^ 0, we consider this as a locally (i.e., 
depending on 6) c-optimal design problem by first writing 



rj « -fl 2 /20 3 - (to - 2 )/(26 3 ) + (0 3 



and hence taking c to be (0, — 1/ (26s), 62/(261))' , or equivalently, 

c=(0,-6 3 ,6 2 y. 



fill 



Chaloner| ( |1989 ) considered a Bayesian approach to this problem in the linear model. 

Although the method described above in Section [2] is for the linear model described in 
Section [TlJ it can be applied to find locally c-optimal designs in the nonlinear model (1 1 Oh , 
and other generalized linear models, without further extension by applying Ford et al.'s (1992) 



results which show that, in this case, the locally c-optimal design can be found by applying 
Elfving's method to a transformed version of the problem as if it were a linear model, described 
next. For a more general description of their method, which covers other models and optimality 



criteria, we refer readers to Ford et al. (1992). 



1 We have verified the values in Lopez-Fidalgo and Rodriguez-Diaz (2004 Table 5) using our method, except for 
the value of \E'(£*) in the case c = e2, k = 3 (d = 2 in their notation), which we calculate to be 1 rather than the 
value 4 given there. 
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In the above notation, x = x(u) = (l,u,u 2 )' and X = {x(u) : u G [—1, 1]}. Given 9, let 
B = B(9) = \\9\\U where U = U(9) is a 3 x 3 orthonormal matrix with third row equal to 
Then the locally c-optimal design can be found by finding the (Sc)-optimal design in 
the transformed design space 



Q = {w(zs)z : z = Bx, x S X} where u>(C) = e^ 2 / (1 + e 



:i2) 



and then transforming back to X via B . We give an example of this transformation and 
calculation. 

Letting 9 = (2, —6, —9)', a B satisfying the above assumptions is 



B 



10.816 

2 



1.110 
9.153 
-6 



1.664 
-6.102 
-9 



(13) 



to 3 decimal places. Figure [T] shows X, Q for this B, and the reflection Q~ of Q through 
the origin, and Figure [2] shows conv(<5 U G )- For the sake of illustration we choose c = 
(—.195, .1, —.243)', although this does not have first component equal to zero as in (11), and 
this gives Be = (—2.403, 2.398, 1.197)', the red arrow in Figure [2j The method is then used to 
quickly compute the (-Bc)-optimal design on Q and transforming back to X gives, parametrizing 
by u, 

C = {(-1, .135), (.181, .194), (.452, .671)}. 

From Figure [2] it is clear that the (-Bc)-optimal design on Q will be supported on the point 
g at the end of the red curve in Figure [I] with positive second coordinate, plus two interior 
points on the curve. Noting that g corresponds to the u = — 1 end of the curve X under the 
transformation X — > Q, it is not surprising then that £* is supported on u = — 1 plus two 
interior points in (—1,1). 



4 Discussion 



We have given a new characterization of Elfving's method which affords more efficient com- 
putation, particularly in high dimensions where visualization of the Elfving set £ is difficult. 



Dette's (1993b) extension of Elving's method to the popular D-optimality criterion holds the 
possibility extending the current computational method to find D-optimal designs. The ap- 



proach of Ford et al. (1992) to generalized linear models applied in Section 3.2 would apply 



there as well since the .D-optimality criterion is also l?-invariant. 



Another tantalizing area of extension is constrained c-optimal designs (Cook and Wong 



1994, Cook and Fedorov 1995). With linear constraints on the design measure, as in Cook 



and Fedorov (1995, Section 1.3), it can be shown that the constrained problem has similar 
ingredients to the standard c-optimal design problem. For example, the subset of points in 
£ which satisfy the constraint is convex and symmetric about the origin, so one may suspect 
that, like the standard problem, the point where the ray R{c) pierces this subset is a natural 
candidate for the constrained c-optimal design. However, difficulties remain in this approach, 
such as showing that an Elfving-like characterization like ^ holds for the constrained problem. 
Stigler ( 1971 ) has pointed out similar difficulties for the constrained D-optimal problem. 
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Appendix: Properties of the design (4) and proof of 



Theorem 2.1 



Before giving the proof of Theorem 2.1, we state and prove Proposition |4.1| which gives the 
properties of the design £*, given by Q, and the "Elfving point" z*, given by ([5]), needed to 
prove Theorem 2.1 We state this as a separate proposition because it may be of interest on 
its own. In particular, Claim [5] of Proposition 4.1 shows that the weights ([8]) of the design 
£*(x\, . . . , xi) are optimal for the given support set x\, . . . ,xe, showing that the formulae @-((8]) 
can be used to compute sub-optimal designs with prescribed support. 

Proposition 4.1. Let x\, . . . , xi G X , £ < k, be LI such that c G span(xi, . . . ,x#). Then the 
following hold. 

1. • • • , xi) and z*{x%, . . . , xg) are invariant with respect to the choice of generalized 
inverse in Q-Q 

2. z*(xi, ...,Xi) G R{c) 

3. ?(x 1} ...,x t ) G 3 

i ^(r(xi,...,^)) = i| c || 2 /iiz*(x 1 ,...,x,)n 2 

5. €*(x 1} ...,xt) = argmin^gB^^...^) 
Proof. For any design £ = {{xi,pi)}f =1 G 3, we have that c = M(£)d for some d, hence 

c = M(£)d = M(i)M{i)- l M{i)d = M(OM(e) _1 c = {^JPiXiX^ Af(0 _1 c 

l 

= Y.PMMiO^^Xi. (14) 

8=1 



x'jM~ l c 



Letting M be as in ([7]) , we have that c G span(xi, . . . , xi) C colspace(M) by Lemma 4.1 which 
is further below in this appendix. Let 7 = £/ Ylj=i 



and denote z*(x\, . . . , irg) simply 



by z*. Applying (14) with £ = {(x{, l/£)}f =1 gives 



c = r 1 ^2(x' t M- 1 c)x l = 7 - 1 ^2e*pl 



-1 * 
Xj = 7 2 . 



(15) 



i=l 



i=i 



This gives Claim[2j and also Claim[3j as follows. By relabeling if necessary, let x\, . . . , x m , m < 
£, be the x±,. . . ,xg corresponding to nonzero p*'s. Then ( 15 ) shows that c G span(xi, . . . , x m ) C 



colspace(M(£)) by Lemma 4.1 



get 



Denote C( x ii ■ ■ ■ t x e) = {Ozi>P*)}E=l simply by £*. For Claim|4j apply ([TI]) with £ = £* to 



c =X; P *(^M(r)- 1 c)x i , 



i=i 



and subtracting this from the second-to-last expression in (15) (with m in place of £) gives 



Y J {<h-^M{e)- l c)p*x l = ^. 



8=1 
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Since the x\ are LI and all the p* in the sum are positive, this gives 

xjM(f*) -1 c = e *h for alH = 1, . .. ,m. 

Then 



(16) 



^{e) = c >M{ey l c= U-'E^O ^(tr 1 c = 7 - 1 E e ^M(f)- l c) 



i=i 



i=l 

m 

T iy E<titift)= 7- 2 = l|c|| 2 /lk*H 2 , 



this last by (15), proving ClaimEl 

To show Claim [5j subtract ( fl4[ ) from the second-to-last expression in ( 15 ) to get 

I 

E [ £ ^*/7 " Pl {x l M{ty 1 c)} Xi = 
i=l 

which, by linear independence, gives 

Pi(xjAf (0 _1 c) = e*K/7 for all i = !,...,£. 



(17) 



Then, using (|14|) and (|17j), 



(f ) = t/M^ ) -1 c 



8=1 



i=l 

E ft^co-'c 

i: Pi>0 



-l-\2 _ 7 -2 



E (pj) a /ft- (18) 

i: Pi>0 



Then the method of Lagrange multipliers easily shows that pi = p* for all i minimizes ( 18 ) 
subject to YLiPi = 1> proving Claim [5j 

Finally, to prove Claim m suppose a different generalized inverse is used for M 1 , resulting 
in £,£j,pj,7, z instead of £*, £*,p*, 7, £*. By the same argument leading to (17) we would have 



tiVill = £ *iP*ih for alH = 1, . 
Also, using (15) and Claims [4] and [5j 

I"- I' — ;*M-l/2 _ [$(^)]-V2 



(19) 



7 



[*(£*)]" 



7, 



hence (19) shows that e*p* = EiPi for all i, and it follows that £,* = S, and z* 



□ 



Proof of Theorem 



2.1 



Denote £*(#*,.. simply by £*. Let £ = {(a>j,Pi)}f =1 , Pi > 

and £ < fc, be the design given by Elfving's method. If x±, . . . ,xi are LI then they can be 



completed to a LI set x\, . . . , Xk € X by our assumption in the first paragraph of Section 1.1 
Then £ £ E(x 1: . . . ,x k ) and so < by Claim [5] of Proposition [4?T 



Otherwise, assume that x\, . . . ,xg are linearly dependent (LD|. In this case we will construct 
a design £ whose support is a strict subset of x%, . . . ,xg and Vl/(£) < ^(0- This argument can 
be repeated until only a LI support set remains, and the previous argument can be applied. 
By ([3]), = ||c|| 2 /|| Yli=i £ iPi x i\\ 2 for some choice of signs £j, and let 2 = Yli=i £ iPi x i- Since 
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x%, . . . ,X£ are LD, E\X\, . . . , £gX£ are also LD so let a\, . . . , ai be constants, not all 0, such that 
J2i=i a i £ i x i = 0- Without loss of generality assume that Yli=i a i — 0' since otherwise each aj 
could be replaced by — «j. Now set xo = 0, £o = 1, po = 0, and ao = — Ym.=i a i — 0- With 
this, we have that ao,...,a£ are not all and satisfy 

i i 

a i £ i x i = an d a?. = 0. (20) 

i=0 i=0 

(In other words, £0X0, . . . , e^x^ are affinely dependent.) Now set 

5 = mm{pi/ai : i = 0, ...,£, on > 0} 

and qi = Pi — Soti, i = 0, . . . , £, and note that qi > for all i and 

I i t 

i=o i=0 i=0 

Note also that qi = for some < i < £ by definition of 5 and by virtue of the fact that 
ao < 0. By relabeling, assume that qi = 0. We have 



-i 

: - z - = ^piEiXi - S^aiEiXi = ^qiEiXi = ^^ejXj. (21) 

i=0 i=0 i=0 



It cannot be that qo = 1 since this would imply that z = by (21) and it would follow that 
c = 0, contradicting our assumption, hence qo < 1. Let Xq be any compact set containing 
*U{0}, 

t = {(xi, *)}f=o> and £ = {( Xi , g;/(l - qo))}iz[- 



The former is a design on Xq by virtue of its inclusion of xq = in its support. Then (21) 
implies that < <£(£). Also, 



£-1 



M(0 = (1 - go)' 1 1^ x 'i = ( X - ft))"' E = ( X " 9o) _1 M(0 

so that 

^(0 = cM(i)- l c = (1 - g )tf (0 < < *(0. 
thus completing the desired reduction to the smaller support set xi, . . . , xt-\. □ 

Lemma 4.1. Lei xi, . . . ,xi € X. Then 

colspace (m({(xj, <?i)}f =1 )J C span(zi, . . . , xg) /or any % > 0, Ya=\ Qi = 1 - ( 22 ) 
Conversely, 

span(x 1 , ...,Xi)C colspace (jM({(xi, qi)}f =1 j\ for any qi > 0, Yh=\ H = l - (23) 
Proof. Let M = M({(x i} «)}i=i)- For an y a 6 K £ , 

Ma = 1i x i x 'i a = (l iX 'i a ) Xi e span(xi, . . . , x^). 

\i=l / i=l 



S 



Conversely, given constants a±, . . . ,ae and strictly positive q±, . . . , qe, we will show that Yli=i a i x i e 
colspace(M). Let b = (tti/y^i, • • • , Q-i/^Jqi>)' S M^. Let X be the £ x k matrix with rows 
^/qlx' 1 , . . . , ^fqtx'j, and note that X'A = ^ i=1 qiXix\ = M. Let t> be the projection of b onto 
colspace(A) and let d be any vector such that Xd = v. Then (b — v) _L colspace(X), or 
X'6 = X'v, so we have 

I 

a iXi = X'b = X'v = X'Xd = Md€ colspace(M). 

i=i 

□ 
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Table 1: c-optimal designs £* for polynomial regression model Y ~ -A/"(X)^=i ^i u% ^ 1 ^ °" 2 ) an d c equal 
to standard basis vectors e±, . . . , e& G M fc for k = 6, . . . , 10. Parametrizing £* by u G [— , 1, 1], column 
3 is £*(0) and the pairs (u,p) in columns 4-8 are the positive u values such that £*(tt) = £*(— u) = p. 
The support points and weights are given to 3 decimal places. 



j : c = e,- 



r(o) 



such that £*(u) = M ) = 



1 

2 
3 
4 
5 
6 



1 


3/8 


1/4 




.309, .419) 
707, 1/4) 
309, .265) 
707, 1/4) 
.309, 1/5) 



.809, .061) 
1, 1/16) 
.809, .175) 
1, 1/8) 
.809, 1/5) 



1, 1/50) 
1, .06) 
1, 1/10) 



1 

2 
3 
4 
5 
6 
7 



1 


.352 


2/9 



1/6 



.309, .419) 
.5, 2/9) 
.309, .265) 
.5, .194) 
.309, 1/5) 
.5, 1/6) 



809, .061) 
866, .074) 
809, .175) 
866, .175) 
809, 1/5) 
866, 1/6) 



1, 1/50) 
1, .028) 
1, .06) 
1, .06) 
1, 1/10) 
1, 1/12) 



1 

2 
3 
4 
5 
6 
7 



1 


.352 


2/9 



1/6 




223, .412) 
.5, 2/9) 
.223, .248) 
.5, .194) 
.223, .180) 
.5, 1/6) 
.223, .143) 



623, .052) 
866, .074) 
623, .147) 
866, .139) 
623, .152) 
866, 1/6) 
623, .143) 



.901, .025) 
1, .028) 
.901, .075) 
1, 1/18) 
.901, .117) 
1, 1/12) 
.901, .143) 



1, .010) 
1, .031) 
1, .051) 
1, .071) 



1 
2 
3 
4 
5 
6 
7 
8 
9 

2 
3 
4 
5 
6 
7 
8 
9 

10 



1 


.344 


.213 


.156 



1/8 

1 


.344 


.213 


.156 



1/8 




.223, .412) 
.383, .213) 
.223, .248) 
.383, .178) 
.223, .180) 
.383, .147) 
.223, .143) 
.383, 1/8) 

.174, .409) 
.383, .213) 
.174, .241) 
.383, .178) 
.174, .172) 
.383, .147) 
.174, .134) 
.383, 1/8) 
.174, 1/9) 



623, .052) 
707, .063) 
623, .147) 
707, .113) 
623, .152) 
707, 1/8) 
623, .143) 
707, 1/8) 

5, .049) 
707, .063) 
5, .137) 
707, .113) 
5, .136) 
707, 1/8) 
5, .123) 
707, 1/8) 
5, 1/9) 



.901, .025) 
.924, .037) 
.901, .075) 
.924, .072) 
.901, .117) 
.924, .103) 
.901, .143) 
.924, 1/8) 

.766, .021) 
.924, .037) 
766, .062) 
.924, .072) 
.766, .093) 
.924, .103) 
.766, .107) 
.924, 1/8) 
.766, 1/9) 



1, .010) 
1, .016) 
1, .031) 
1, .031) 
1, .051) 
1, .047) 
1, .071) 

1, 1/16) 

.940, .014) (1, .006) 
1, .016) 

.940, .042) (1, .019) 
1, .031) 

.940, .068) (1, .031) 
1, .047) 

.940, .092) (1, .043) 
1, 1/16) 

.940, 1/9) (1, 1/18) 
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12 



8 8 



92 



91 



Figure 2: conv(Q U Q 



for the quadratic logistic regression example in Section 3.2, with Q given 

-2.403,2.398,1-197)'. 



by (12) with B equal to (13) and with red arrow Be 
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